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(54) DEVICE AND METHOD FOR RESTORING IMAGE 

(57)Abstract: 

PURPOSE: To restore a degraded image by classifying 
blocked data into plural classes, obtaining class codes 
corresponding to the classification and outputting an 
image without degradation corresponding to this class 
code. 

CONSTITUTION: A blocking circuit 2 divides an input 
image, which is supplied through an input terminal 1 and 
starts degradation, into plural blocks. A class code 
generating circuit 3 classifies the blocked data into the 
plural classes and outputs the class codes 
corresponding to the classification. A ROM table 4 
outputs the image without degradation corresponding to 
the input image corresponding to the class code. In this 
case, the result of previously learning with the data, for 
which the image without degradation is divided into 
blocks, and the data classifying the image, for which the 
image with no degradation divided into blocks is 
degraded with a prescribed degradation function, into 
classes is stored in the ROM table 4 as a table 
corresponding to the class code. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image-restoration equipment carry out [ coming to have in a blocking means divide 
into two or more blocks the input image which has produced degradation, a class classification 
means classify the blocked data into two or more classes, and output the class code 
corresponding to the classification, and a non-deteriorated image output means output the image 
which does not have degradation corresponding to an input image according to the above- 
mentioned class code, and ] as the description. 

[Claim 2] The above-mentioned non-deteriorated image output means is image-restoration 
equipment according to claim 1 characterized by to have made the above-mentioned class code 
correspond and to have memorized the result learned beforehand by the data which blocked the 
image without degradation, and the data which gave the class classification to the image which 
degraded the image without the blocked degradation concerned with the predetermined 
degradation function. 

[Claim 3] The above-mentioned non-deteriorated image output means is image restoration 
equipment according to claim 1 characterized by having made the above-mentioned class code 
correspond and having memorized the result learned beforehand by the data which blocked the 
image which deteriorated and carried out the class classification, and the data which blocked the 
image without degradation. 

[Claim 4] The image-restoration approach which carries out [ coming to have the class 
classification procedure which classifies into two or more classes the data blocked the block 
chemically-modified / which divides into two or more blocks the input image which has produced 
degradation / degree, and outputs the class code corresponding to the classification, and the 
non-deteriorated image output process which output the image which does not have degradation 
corresponding to an input image according to the above-mentioned class code, and ] as the 
description. 

[Claim 5] The image-restoration approach according to claim 4 characterized by to take out the 
study value corresponding to the above-mentioned class code from two or more study values 
which learned beforehand and acquired by the data which blocked the image without degradation 
at the above-mentioned non-deteriorated image output process, and the data which gave the 
class classification to the image which degraded the image without the blocked degradation 
concerned with the predetermined degradation function. 

[Claim 6] The image restoration approach according to claim 4 characterized by taking out the 
study value corresponding to the above-mentioned class code from two or more study values 
which learned beforehand and were acquired by the data which blocked the image which 
deteriorated at the above-mentioned non-deteriorated image output process, and carried out 
the class classification, and the data which blocked the image without degradation. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image restoration equipment and the 
approach of restoring the image which deteriorated to an image without degradation 
(restoration). 
[0002] 

[Description of the Prior Art] In restoring conventionally the image with which image quality 
deteriorated, it is made to perform image restoration by analyzing the cause of degradation, 
asking for the model function of the degradation, and giving the inverse function corresponding 
to the model function of the above-mentioned degradation to the image which carried out 
[ above-mentioned ] degradation. 
[0003] 

[Problem(s) to be Solved by the Invention] By the way, various kinds of things, such as what is 
depended on a uniform motion of a camera (image photography equipments, such as a video 
camera) as a cause of the above-mentioned degradation, and dotage by the optical system of a 
camera, can be considered. Therefore, when restoring the above-mentioned image, the model 
function of the above-mentioned degradation will also change with causes of each degradation. 
[0004] If the cause of the degradation cannot be specified when it is going to restore 
degradation since it is such, the above-mentioned model function cannot be determined but 
restoration will become difficult. 

[0005] Moreover, even if it is able to stand the model function of the cause of degradation, there 
is a case where the inverse function for restoring does not exist, plentifully, and evaluation of 
the optimal model in that case is also difficult. 

[0006] That is, in restoring the image with which image quality deteriorated, it restores by 
analyzing the cause of degradation, determining a degradation model function, and giving the 
inverse function, but restoration becomes difficult when neither the case where the cause of 
degradation cannot be specified as mentioned above, nor an inverse function can be determined 
uniformly. 

[0007] Then, even if this inventions are the case where the cause of degradation cannot be 
specified in view of what mentioned above, and the case where an inverse function cannot be 
determined uniformly, they aim at offering the image restoration equipment and the approach 
which can perform restoration of the image which deteriorated. 
[0008] 

[Means for Solving the Problem] This invention is proposed in order to attain the above- 
mentioned purpose. The image restoration equipment of this invention A blocking (scan 
conversion of input image is carried out) means to divide into two or more blocks the input image 
which is equipment which restores the image with which the image quality of a digital image 
signal deteriorated, and has produced degradation, A class classification means to classify the 
blocked data into two or more classes, and to output the class code corresponding to the 
classification. It comes to have a non-deteriorated (for data by which study optimization was 
carried out beforehand to be outputted) image output means to output the image which does not 
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have degradation corresponding to an input image according to the above-mentioned class code. 

[0009] Here, the above-mentioned non-deteriorated image output means has memorized the 
result (study value) beforehand learned by the data which blocked the image without degradation, 
and the data which gave the class classification to the image which degraded the image without 
the blocked degradation concerned with the predetermined degradation function as a table to 
which the above-mentioned class code was made to correspond. Or the above-mentioned non- 
deteriorated image output means has memorized the result (study value) beforehand learned by 
the data which blocked the image which deteriorated and carried out the class classification, and 
the data which blocked the image without degradation as a table to which the above-mentioned 
class code was made to correspond. 

[0010] Moreover, the image-restoration approach of this invention comes to have the class 
classification procedure which classifies into two or more classes the data blocked the block 
chemically-modified [ which divides into two or more blocks the input image which has produced 
degradation ] degree, and outputs the class code corresponding to the classification, and the 
non-deteriorated image output process which output the image which does not have degradation 
corresponding to an input image according to the above-mentioned class code. 
[001 1] Here, at the above-mentioned non-deteriorated image output process, the study value 
corresponding to the above-mentioned class code is taken out from two or more study values 
which learned beforehand and were acquired by the data which blocked the image without 
degradation, and the data which gave the class classification to the image which degraded the 
image without the blocked degradation concerned with the predetermined degradation function. 
Or at the above-mentioned non-deteriorated image output process, the study value 
corresponding to the above-mentioned class code is taken out from two or more study values 
which learned beforehand and were acquired by the data which blocked the image which 
deteriorated and carried out the class classification, and the data which blocked the image 
without degradation. 
[0012] 

[Function] According to this invention, the result (restoration table) of having learned beforehand 
the image with which image quality deteriorated, and having obtained it with the data which 
carried out the class classification for every block, and the block data of an image without 
degradation is saved. That Is, since the table by study is learned between the image which 
deteriorated, and the image without degradation, it can obtain the image with which degradation 
was restored by the thing which take out the study value corresponding to the class code by 
class classification of the image which deteriorated from this table (the restoration image which 
does not have degradation instead of the image which deteriorated applies (mapping)) and which 
makes like. Moreover, once it creates a table, since restoration of an image is only processing 
which reads a table, it will become easy to process it. 
[0013] 

[Example] Hereafter, it explains, referring to a drawing about the example of this invention. 
[0014] As the image restoration equipment of the 1st example of this invention is equipment 
which restores the image with which the image quality of a digital image signal deteriorated and 
is shown in drawing 1 The blocking (scan conversion of input image is carried out) circuit 2 which 
divides into two or more blocks the input image which has produced degradation supplied 
through an input terminal 1, The class code generating circuit 3 which is a class classification 
means to classify the blocked data into two or more classes, and to output the class code 
corresponding to the classification, It comes to have the ROM table 4 which is a non- 
deteriorated (data by which study optimization was carried out beforehand are outputted) image 
output means to output the image which does not have degradation corresponding to an input 
image according to the above-mentioned class code. 

[0015] The result (a study value) which learned beforehand by the data which gave the class 
classification to the image degraded with the predetermined degradation function which mentions 
the data which blocked the image in which the above-mentioned ROM table 4 does not have 
degradation here, and an image without the blocked degradation concerned later has memorized 
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as a table to which the above-mentioned class code made correspond (the 1st example which 
mentions later). Or the result (study value) beforehand learned by the data which blocked the 
image which deteriorated and carried out the class classification, and the data which blocked the 
image without degradation is memorized as a table to which the above-mentioned class code 
was made to correspond (the 2nd example mentioned later). Moreover, the above-mentioned 
class code generating circuit 3 asks for the multiplier group of the formula showing the 
configuration nearest to an input image, using a high order polynomial which is mentioned later as 
a model type, and performs a class classification according to this multiplier group. 
[001 6] Here, in advance of explanation of the configuration of the image restoration equipment of 
this invention example, generation of the study in image restoration and a ROM table is 
explained. 

[0017] When the table learned beforehand tends to perform image restoration, it is necessary to 
carry out study processing between the image which deteriorated, and a beautiful image without 
degradation. As an approach of obtaining the degradation image used for study, the photographic 
subject is fixed, for example, a camera is moved and it flows, and an image is generated or there 
is [ the focus of a camera can be shifted intentionally, it fades and ] the approach of generating 
an image. 

[0018] Here, the 1st example of the flow of the processing when learning using a degradation 
image is shown in drawing 2 , 

[001 9] In this drawing 2 , an image without degradation is supplied by step S9. At the following 
step S10, the above-mentioned degradation-less image is blocked and it sends to step SI 3. 
Moreover, the degradation-less image of step 810 is degraded using a known degradation 
function in step S1 1. Then, clustering which classifies into a class the block data degraded with 
the above-mentioned degradation function according to step 812 is performed, and it progresses 
to step S13. In addition, a class classification is a pattern classification using the blocked image 
data. 

[0020] At step SI 3, it trains between block data without degradation from the above-mentioned 
step 810, and the block data which was degraded from the above-mentioned step SI 2, and 
carried out the class classification (study). 

[0021] At step SI 4, it judges whether study was repeatedly performed to extent to which all 
class study is fully performed to all blocks that constitute an image. If it is judged return and yes 
by step S10 when judged no at this step S14, it will progress to step SI 5. 

[0022] Step SI 5 generates a mapping table with the optimum value learned for every class. This 
serves as a ROM table. 

[0023] Although the 1st example of the above is generating the degradation image by degrading a 
degradation-less image with a degradation function, like the 2nd example described below, as 
beforehand mentioned above, it can also learn using the degradation image which carried out 
shifting migration of a camera and a focus etc. and was generated, and the flow of processing in 
this case comes to be shown in drawing 3 . 

[0024] In this drawing 3 , an image without degradation of the degradation image generated 
physically beforehand at step S2 is supplied at step 81. At step S3, the above-mentioned 
degradation image is blocked and the above-mentioned degradation-less image is blocked in step 
S4 in the location corresponding to blocking at step S3. 

[0025] At the next step 85 of step 83. clustering which classifies the block data of the above- 
mentioned degradation image into a class is performed. It is the thing of a pattern classification 
using the image data which also blocked this class classification. 

[0026] At step S5 and step 86 which progresses after processing of step S4, it trains by being 
between the blocks of the above-mentioned degradation image and a degradation-less image 
(study). 

[0027] At step 87. it judges whether study was repeatedly performed to extent to which all class 
study is fully performed to all blocks that constitute an image. When judged no at this step S7, to 
a degradation image, it passes step S3, and returns to tetraethylpyrophosphate 84 to a 
degradation-less image. If judged yes at step 87, it will progress to step 88. 
[0028] Step SB generates a mapping table with the optimum value learned for every class. This 
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serves as a ROM table. 

[0029] In addition, there is a pattern of some [ how the block of the above-mentioned 
degradation image and the block of a degradation-less corresponding image are learned ]. For 
example, it may learn and output by the case where it learns and outputs with the block of a 
degradation image, and the block of a degradation-less image, and the pixel. The case where the 
input image itself is learned as data furthermore learned, and a difference daily dose with a 
degradation filter may be learned. 

[0030] Moreover, although live data can also be used for the class in the 1st and 2nd example of 
the above, if the memory space which considered implementability is taken into consideration, it 
is possible [ it ] to use a data compression etc. for a class classification. 

[0031] In a data compression, the adaptive quantization (referred to as ADRC) according to the 
dynamic range of the picture signal mentioned later, DPCM (differential PCM), vector 
quantization (VQ), etc. can be considered. 

[0032] In addition, Above ADRC is a thing which was adapted for the above-mentioned dynamic 
range for which blocked the digital image signal, and asked for the dynamic range specified by 
two or more maximums and minimum values of pixel data which are contained in this block, and it 
asked in this block unit and which assigns and encodes each pixel data within the block 
concerned with the number of bits. Speaking more concretely, Above ADRC asking for the 
dynamic range (difference of the maximum level within a block, and the minimum level) specified 
by the maximum of two or more pixels and the minimum value which are contained in a block 
predetermined [ in one frame (or field) ]. The acUustable quantifying bit number which was 
adapted for this dynamic range is determined for every above-mentioned block, this quantifying 

bit number — the input data after minimum value removal — coding (quantization re ) Namely, 

while the compressed quantifying bit number divides a dynamic range equally, encoding and using 
each pixel within a block as the code of the nearest level and obtaining a coding code It seems 
that it uses as an addition code any [ the information on a dynamic range, and ] of the above- 
mentioned maximum and the minimum values to be, and these coding code and an addition code 
are obtained. 

[0033] Furthermore, the following approaches are used for the implementation approach of 
clustering, 

[0034] Here, as simplest approach, there is the technique of making a class number the bit 
sequence of the study data within a block as it is, for example by class division. However, by this 
technique, ROM of a huge capacity is needed. 

[0035] For this reason, in this example, Above ADRC is used for the class division by the signal 
pattern, and the effective number of classes which saved the property of a signal pattern is 
reduced. Here, as shown in drawing 4 , the prediction to the HARASHIN number pixel A is taken 
for an example from the study signal pixels a, b, and c, and it is the level of the study signal 
images a, b, and c, respectively x1, x2, and x3 It carries out. Moreover, it is re-quantization data 
of the result of having performed p bit ADRC to x1, x2, and the data of x3, respectively q1. q2, 
and q3 It carries out, and the dynamic range is set to DR and the minimum value is set to min. 
[0036] At this time, class number (class code) class of this block is defined by the formula (1). 
[0037] 
[Equation 1] 

3 J -I 

- (1) 



class = '^qi(2') 



[0038] In addition, originally ADRC is the accommodative re-quantizing method developed for 
[ to turn ] high efficiency coding VTR (video tape recorder), and since the local pattern of signal 
level can be efficiently expressed by the short word length, in this example, this is used for code 
generating of a class classification of a signal pattern. 

[0039] More generally it explains. They are x1, xn about study signal pixel level. When it 

carries out and the HARASHIN number pixel level is set to y, they are multipliers w1 wn for 

every class. Linearity presumption type of n tap to depend (2) y=w1 x1+w2 x2+ ... +wn xn (2) 
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It sets up. In addition, it is wi before study. It is an undetermined coefficient. 
[0040] Study is perFormed to two or more signal data for every class. When the number of data 
is m, it is a formula (2) (prediction type). It follows and is yk =w1 xk1+w2 xk2+.„ +wn xkn (k= 1, 2, 
.... m) (3) 

In M>n, they are w1 wn. Since it does not become settled uniquely, it is [ ] the element of the 

error vector e ek =yk-{w1 xk1+w2 xk2+ ... +wn xkn} (4 (k= 1, 2, .... m)) 

A definition is given and it is a formula (5). It asks for the multiplier made into min. It is a solution 
method by the so-called least square method. 
[0041] 
[Equation 2] 

^2 = 1;^}^ (5) 

it=i 

[0042] Here, it is a formula (5). wi About ********** to depend, it is a formula (6). It asks like. 

[0043] 

[Equation 3] 

^ — e, = y2x,re, (6) 



m 



[0044] The above-mentioned formula (6) It is each wi so that it may be made 0. Since what is 

necessary is just to decide, it is a formula (7). Formula (8) It is [0045] like. 

[Equation 4] 
m 

(7) 



[0046] 

[Equation 5] 
m 



(8) 



[0047] It is a formula (9). when it carries out and a matrix is used. It becomes like and is [0048]. 
[Equation 6] 



X. 



21 



X 

X. 



22 



'n2 



X 
X 



In 



In 
Xnn 



• ■ • 

\Wn J 



(9) 



[0049] sweeping out — general matrix solution methods, such as law, — using — wi ******** - 
- if it solves, a prediction coefficient can be found and this prediction coefficient is stored as 
data (ROM table) of the address class of ROM in this example. 

[0050] Next, the above-mentioned degradation function is explained below. First, the image 

observation model which took the noise into consideration is considered. The image observation 

model which took this noise into consideration can be expressed like a formula (10). 

g=Af^n (10) In addition, in this formula (10), in f. observation data and A express an observation 

process and. as for n, a subject-copy image and g express the additivity noise. 

[0051] Here, it is the space where the target subject-copy image f belongs HI It is the space 

where it carries out and the observation data g belong H2 Noise n is H2 when it carries out. It is 

origin and Observation A is HI mathematically. H2 It can be regarded as an operator, f and g may 

be expressed as an array which may be expressed as a function defined on the continuation 

field, and was defined on the dispersed point. In the case of the latter, it is the same as a vector. 
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According to these expression approaches, the model of a formula (10) is called as follows. 
Namely, HI When both H2 is functional space, it is called a continuation-continuous model, and 
in both the cases of vector space, it is called discrete - dispersion model. Moreover, HI It is H2 
in functional space. The case where it is vector space is called continuation-dispersion model. 
[0052] In the case of the above-mentioned continuation-continuous model, the above- 
mentioned formula (10) is expressed like a formula (1 1). 
[0053] 
[Equation 7] 

gix.y) = DrJ^U3'.-^'.y')/U',v')d:rVv +nU. v) (l 0 

[0054] In addition, in this formula (11). f (x y) is [ a degradation image and n (x y) of a subject- 
copy image and g (x y) ] noises, and h (x, y. x', y') is called a degradation function, for example, f 
(x y) =delta (x-alpha, y-beta) — the degradation image to the point light source is h (x y, alpha, 
beta). Therefore, a degradation function may be called a point spread function (PSF:point spread 
function) to coincidence. 

[0055] When the image with which the point light source deteriorated does not call at the 
location of the point except for a parallel displacement here, a point spread function turns into a 
function of h (x-x', y-yO and difference type, and the above-mentioned formula (1 1) is a 
convolution integral (convolution) like a formula (12). It is expressed. 
[0056] 
[Equation 8] 

8ix,y) = rSJ^(^ -x,y- y')/(,r y')dx'd/ + nCx, y) (l 2) 

[0057] such degradation — migration unchangeability, location unchangeability, or space — it is 
said that it is eternal. A formula (11) may be convertible for the format of a formula (12) with a 
change of variables. 

[0058] Moreover, degradation may be separable in the direction of a x axis, and the direction of 
the y-axis. Speaking mathematically, the degradation function's supporting that it can 
decompose into the form of a product like a formula (13). 

h(x, y, x', y') =h1 h(x x') 2 (y, y) (13) This is called isolated nuclei. Sure of the photograph by 
uniform motion of a camera — isolated nuclei and migration — it is the example of eternal 
degradation. 

[0059] Moreover, discrete - dispersion model of the above-mentioned formula (10) is as follows. 
For example. N dimension vector made from the value in the sample point of N individual of the 
subject-copy image f (x y) is set to f. g, n. then the above-mentioned formula (1 1) are the 
degradation image g (x y) and Noise n (x y), and N dimension vector made in approximation 
similarly, respectively g=Af+n It can express (14). Here, A in a formula (14) is the Nth square 
matrix showing degradation. 

[0060] Moreover, a sample point is N1 xN2. When given in the lattice point (xm and yn) of an 
individual (N=N1 xN2), the sampled value f (xm and yn) of f (x y) can be put in order as it is, and 
can be expressed with the form of a matrix. This is set to [f]. It is similarly referred to as [g] and 
[n] to the degradation image g (x y) and Noise n (x y). Furthermore, suppose that they are 
Degradation A isolated nuclei like a formula (13). At this time, the formula (1 1) of a continuation- 
continuous model is discrete - dispersion model in approximation, [g] =A1 [f] A2+ [n] It can be 
expressed as (15). Here, it is A1 and A2. It is N1, respectively. A degree and N2 It is degree 
square matrix. 

[0061] furthermore, the degradation A — migration — case it is eternal — a formula (1 2) — 
receiving — A1 of a formula (1 5), and A2 Tape RITTSU (Toeplitz) If approximated in procession, 
it is convertible for a diagonal matrix with discrete Fourier transform (DFT). This is equivalent to 
changing the convolution integral of a formula (12) into the form of a product with the Fourier 
transform. 

[0062] Next, after degradation by the continuation-continuous model, a continuation-dispersion 
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model performs sampling and changes it into Vector g or a matrix format [g]. Therefore, in the 
part of the first half, it is a formula (1 1). The expression of a formula (15) can be used. Or these 
two processes can be summarized and it can also express like a formula (16X 
[0063] 
[Equation 9] 

8ij = CD'^C-^. v)/U V + n: , (l6) 

[0064] this formula (16) — gij and nij — respectively — the [ of [g] and [n] ] — it is ij 
component. 

[0065] In addition, as shown in the above-mentioned formula (11) - the formula (19), there are 
many approaches of expressing an image degradation model concretely. 
[0066] It returns to drawing 1 and the example of a configuration of the image restoration 
equipment of the 1st example which reads data from the ROM table which learned as mentioned 
above and was obtained, and performs image restoration is explained. The image restoration 
equipment of drawing 1 shows the configuration in the case of outputting the pixel which 
restored degradation to the input degradation image. 

[0067] In this drawing 1 , the digital image signal which was inputted into the input terminal 1 and 
which deteriorated is sent to the blocking circuit 2. The supplied digital image signal is divided 
into two or more blocks which consist of two or more pixel data in the blocking circuit 2 
concerned. 

[0068] The block data from the above-mentioned blocking circuit 2 is sent to the class code 
generating circuit 3. In the class code generating circuit 3 concerned, it asks for a class with 
reference to the pattern of two-dimensional level distribution of the supplied block, and the class 
code is generated. 

[0069] This class code is sent to the ROM table 4 as address data. The study value (namely, 
pixel data without degradation) mentioned above is stored in the ROM table 4 concerned, and 
the study value is outputted corresponding to the above-mentioned class code (address). The 
study value, i.e., pixel data without degradation, read from the ROM table 4 concerned is 
outputted from an output terminal 5. 

[0070] Next, the configuration in the case of saving the study value of a block unit is shown in 
the ROM table 9 as the 2nd example of this invention at drawing 5 . 

[0071] In this drawing 5 , it is the same configuration as the input terminal 1 of drawing 1 to the 
class code generating circuit 3 up to the class code generating circuit 8 from an input terminal 6. 
Here, the ROM table 9 of drawing 5 outputs the data of a block unit to the ROM table 4 of 
drawin g 1 outputting the data which are not a block unit. 

[0072] The data of the block unit without degradation outputted from the ROM table 9 
concerned are sent to the block decomposition circuit 10. That is. since the output of the ROM 
table 9 is a block unit, by the block decomposition circuit 10, block decomposition is performed 
and the disassembled data turns into output data of a degradation-less image from an output 
terminal 11. The non-deteriorated image output means consists of this 2nd example in the ROM 
table 9 and the block decomposition circuit 10. 

[0073] Next» as the 3rd example of this invention, about the difference of the output of the 
restoration filter which restores degradation with the inverse function of a degradation function, 
and the output of the same blocking circuit 13 as drawing 1 and drawing 5 , when it learns 
previously, the example of an about is shown in drawing 6 . 

[0074] That is. in the class code generating circuit 16 of the image restoration equipment of the 
3rd example shown in this drawing 6 , it is made to perform class classification processing to the 
difference of the input image blocked through the blocking circuit 1 3, and the output which 
filtered that block image through the restoration filter 14. 

[0075] In this drawing 6 , a digital image signal is supplied to an input terminal 12 like the input 
terminals 1 and 6 of drawin g 1 and drawing 5 , and blocking does in the same, same blocking 
circuit 13 as drawin g 1 and drawing 5 . 

[0076] The output of the blocking circuit 13 concerned is sent to the restoration filter 14 which 
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restores degradation of an image with the inverse function of a degradation function. The output 
with which filtering was made with the filter 14 concerned is sent to an adder 15 as a subtraction 
signal. The difference of the block data which the output from the above-mentioned blocking 
circuit 13 was supplied to the adder 15 concerned also as an addition signal at this time, 
therefore was filtered in the adder 15 concerned, and the block data which is not filtered will be 
called for. 

[0077] The output of this adder 15 is sent to the class code generating circuit 16. It asks for a 
class with reference to the pattern of two-dimensional level distribution of the output block of 
the above-mentioned adder 15, and the class code is generated also in the class code 
generating circuit 16 concerned. 

[0078] This class code is sent to the ROM table 17 as address data. The study value which 
learned by the data of the difference of pixel data without degradation and the data which 
filtered pixel data without the degradation concerned with the degradation filter is stored in the 
ROM table 17 concerned, therefore a study value comes to be outputted corresponding to the 
above-mentioned class code (address). 

[0079] The study value outputted from this ROM table 17 is sent as an addition signal as well as 
the adder 18 with which the output of the above-mentioned filter 14 is supplied as an addition 
signal. Thereby, from the adder 1 8 concerned, pixel data without degradation are outputted and 
this is outputted by the output terminal 19. Therefore, the non-deteriorated image output means 
is constituted from this 3rd example equipment by the above-mentioned ROM table 1 7 and the 
adder 18 with which the output of a filter 14 is supplied. 

[0080] In addition, although it is made to give a class classification to said difference with the 
image restoration equipment of the 3rd example, it is also possible to perform a class 
classification, for example to the output of the filter 14 of an input image. 

[0081] As mentioned above, it sets to the image restoration of this invention example. Carry out 
scan conversion (blocking) of the input image with which image quality deteriorated, and class 
generation is performed from this block image data. By outputting the data (data by which study 
optimization was carried out) which act on image restoration from the table beforehand learned 
according to the class (namely, signal pattern), and generating a restoration image from the data 
Even if it is the case where the image with which degradation was restored can be obtained, 
therefore the cause of degradation cannot be specified, and the case where an inverse function 
cannot be determined uniformly, restoration of the image which deteriorated is attained. 
[0082] Namely, although it restores by analyzing the cause of degradation, usually determining a 
degradation model function, and giving an inverse function when it is going to restore the image 
with which image quality deteriorated A sake [ when the ability to determine uniformly neither 
the case where the cause of degradation cannot be specified, nor an inverse function, in this 
invention example ] Instead of using the inverse function of a degradation model function, he is 
trying to restore an image using the restoration table beforehand obtained by study by the thing 
which apply the restoration image which does not have degradation instead of the image which 
deteriorated (mapping) and to do. 

[0083] Thus, in order to restore an image by mapping on the study table using an image without 
degradation, once it is necessary to ask neither for the decision of a complicated degradation 
function, nor its inverse function upwards and creates a table in this invention example, since it 
is only reading the table of image restoration, processing is easy to process. Moreover, the 
inverse function of a degradation function cannot be defined, but if it is the former, when it 
cannot restore, a restoration table can be created by study. 

[0084] Therefore, according to the image restoration equipment of this example, the image with 
which image quality degradation to the image picturized, for example with the television camera 
was restored can be obtained. 
[0085] 

[Effect of the Invention] As mentioned above, the result of having learned beforehand the image 
with which image quality deteriorated in this invention with the data which carried out the class 
classification for every block, and the block data of an image without degradation is memorized. 
Divide a degradation image into two or more blocks, classify the blocked data into two or more 
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classes, and the class code corresponding to the classification is obtained. Since he is trying to 
output the image which does not have degradation corresponding to a degradation innage 
according to this class code, even if it is the case where the cause of degradation cannot be 
specified, and the case where an inverse function cannot be determined uniformly, restoration of 
the image which deteriorated is attained. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawing 1] It is the block circuit diagram showing the outline configuration of the image 
restoration equipment of the 1st example of this invention. 

[Drawing 2] It is the flow chart of the 1st example about the study in this invention example. 
[Drawing 3] It is the flow chart of the 2nd example about the study in this invention example. 
[Drawing 4] It is drawing for explaining prediction of a study signal image to the HARASHIN 
number image. 

[Drawing 5] It is the block circuit diagram showing the outline configuration of the image 
restoration equipment of the 2nd example. 

[Drawing 6] It is the block circuit diagram showing the outline configuration of the image 
restoration equipment of the 3rd example. 
[Description of Notations] 

2, 7, 13 .... Blocking circuit 

3, 8, 16 .... Class code generating circuit 

4, 9, 17 .... ROM table 

10 Block decomposition circuit 

14 Filter 
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CORRECTION OR AMENDMENT 



[Kind of official gazette] Printing of amendment by the convention of 2 of Article 17 of Patent 
Law 

[Section partition] The 3rd partition of the 7th section 
[Publication date] July 27, Heisei 13 (2001. 7.27) 

[Publication No.] JP,7-67028.A 

[Date of Publication] March 10, Heisei 7 (1995. 3.10) 
[Annual volume number] Open patent official report 7-671 
[Application number] Japanese Patent Application No. 5-213210 
[The 7th edition of International Patent Classification] 

H04N 5/235 
[Fl] 

H04N 5/235 
[Procedure revision] 

[Filing Date] August 18. Heisei 12 (2000. 8.18) 

[Procedure amendment 1] 

[Document to be Amended] Specification 

[Item(s) to be Amended] Claim 

[Method of Amendment] Modification 

[Proposed Amendment] 

[Claim(s)] 

[Claim 1] A blocking means to divide into two or more blocks the input image which has 
produced degradation. 

A class classification means to classify the blocked data into two or more classes, and to output 
the class code corresponding to the classification, 

Image restoration equipment characterized by coming to have a non-deteriorated image output 
means to output the image which does not have degradation corresponding to an input image 
according to the above-mentioned class code. 

[Claim 2] The above-mentioned non-deteriorated image output means is image-restoration 
equipment according to claim 1 characterized by to have made the above-mentioned class code 
correspond and to have memorized the result learned beforehand by the data which blocked the 
image without degradation, and the data which gave the class classification to the image which 
degraded the image without the blocked degradation concerned with the predetermined 
degradation function. 

[Claim 3] The above-mentioned non-deteriorated image output means is image restoration 
equipment according to claim 1 characterized by having made the above-mentioned class code 
correspond and having memorized the result learned beforehand by the data which blocked the 
image which deteriorated and carried out the class classification, and the data which blocked the 
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image without degradation. 

[Claim 4] It has further the restoration section which restores degradation of image data with 
the inverse function of a degradation function, 

difference with the data with which blocking of the above-mentioned class classification means 
was carried out [ above-mentioned ] with the output data from the above-mentioned restoration 
section — the image restoration equipment according to claim 1 characterized by classifying into 
two or more classes the data by which blocking was carried out [ above-mentioned ] based on a 
value. 

[Claim 5] A block chemically-modified [ which divides into two or more blocks the input image 
which has produced degradation ] degree, 

The class classification procedure which classifies the blocked data into two or more classes, 
and outputs the class code corresponding to the classification, 

The image restoration approach characterized by coming to have the non-deteriorated image 
output process which outputs the image which does not have degradation corresponding to an 
input image according to the above-mentioned class code. 

[Claim 6] The image-restoration approach according to claim 5 characterized by to take out the 
study value corresponding to the above-mentioned class code from two or more study values 
which learned beforehand and acquired by the data which blocked the image without degradation 
at the above-mentioned non-deteriorated image output process, and the data which gave the 
class classification to the image which degraded the image without the blocked degradation 
concerned with the predetermined degradation function. 

[Claim 7] The image restoration approach according to claim 5 characterized by taking out the 
study value corresponding to the above-mentioned class code from two or more study values 
which learned beforehand and were acquired by the data which blocked the image which 
deteriorated at the above-mentioned non-deteriorated image output process, and carried out 
the class classification, and the data which blocked the image without degradation. 
[Claim 8] It has further the restoration process which restores degradation of image data with 
the inverse function of a degradation function, 

difference with the data with which blocking of the above-mentioned class classification 
procedure was carried out [ above-mentioned ] with the output data from the above-mentioned 
restoration process — the image restoration approach according to claim 5 characterized by 
classifying into two or more classes the data by which blocking was carried out [ above- 
mentioned ] based on a value. 
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^T**!3> h (x. y. x' . y' ) Ji^ftMlilti^tf 5i:i:tfe5o 

nSt(DT'*S, f (x. y) =6 (x-a, [0 0 5 5] CcT. ;^,^iit0^^it LfdtA^Vtfi^fij^ 

y-U) *5;SJtiitcW-r«miii«A<h (x. y, 50 m^X. ^-o^cDfigtc J:e,*t,^fc ^^y?.A''*)M8i 



(6) 



7-6 7 0 2 8 



g 

{ih (x-x' . y-y' ) tm<Dmmcrj:^. ±tE * [00 5 6] 
iCdDti. ^(12)(DJ:'9ti:, S*ji^ffl»(convolutio {^8l 
n) T'^^^aSo * 

gUy) = j_ir«/^U - ^',y - y')/(^r'. vM<iAr>' + «U y) (12) 
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[0 0 5 7] ccD^oiimtmm^m. asm ^ 



85 [0 0 5 8] ttc. ^ft^xtSTjlRJtyttTjf^lC^gtT' 
tS«^A^fc5o ISc#Wtcm;^ti\ '^imm\ S(13) 



5:^ ( 1 2) <D Jg^tC 1 5 li^ t So 

h (x, y, x' , y' ) = hi 

[0 0 5 9] src, ±ti^m(0MWL-mm^'fMi. 

ij^tOJ;^tc%So i5>Jx(f. mm^{ (x, y) (ONffltO 
§0 |SI»tC^^{tiifl! g ( X . y ) &t>'5i^ n ( X , y ) 

g = A f + n 

[006 1] ?e.tc. ^{bAA<i^l()^gOli^. ^(12) 
tMLT, S(15)(DA, . Az t±'f-r'J<y;' (Toepli 

tz) mix']imm. mmy-uj:.^ (dft) t 

= C^C^hix,y)f(x,y)cbcdy^ni / 



(14) 

. ^(i4)lcfcnt?.A{i. ^* 
= A. Cf] A2 + Cn) 



[0 0 6 4] c<Diic(i6)T% g„&afn,j ^-n-fn 

Cg] Cn] (Omi jfiJt^i-T-feSo 

[0 0 6 5] **3. ±3f©S(ll)~S:(l9)tCS^Lfci-5 

5o 

[0 0 6 6] 0ncRoT> iSe^Oct^lCbT^'SLT 
fife R 0 M r-y;!/*^ 6 r- ^^*/-c L Ti®{i«7t:^ 

[0 0 6 7] C(DiaHi:^l/>T> kilH^^fUCktl-^ti 

;l/lifg!fi^%mS![<Dli^x- P) 5«St<07D 
[0 0 68] ±myoy^itmi^2i3^ih(D-:ru-y^f- 

i/yXo-h'^^^t^o 50 



(x. x' ) (y. y' ) (13) 
10* it^mt N '^iEmmX& 5o 

[0 0 6 0] ^tz. ^**A^N, xNz ffl (N = N, x 
) (0^^,^ (x. , y» ) T'4AP,nTI,^S^^, 
f (x, y) CDS^fBf (x. . yn ) ^^(Dttm^ 
T, ^T?lJ<D^gT'a•rili:*^T'^5o c:n«: [f) tt 

So ^^fkiSftg (x, y) mm^n (x. y) ICWL 

-ct> mmz [g] , [n) tfSo ^e.tc, '^{tAt* 

S(i3)cDj:otc»g|)Klc^-3Ti^St1-5c cOi:t. 
(15) 

* [0 0 6 2] i^tc. ®K-gtMfetx;Ki, iii^-lM* 

^jiOSP^tCtt^dl), S(15)(Dg]l*<g9 il ilA^T't 
So CCi2-0<Digg*St46T, it(16)(DJ:-5 

fc-^?l-rsci:tT'#So 

[0 0 6 3] 
[?S9] 

(16) 



[0 0 6 9] dO^'^Xn-Kti. 7Y\y7.9-^th 

tcti. ±aLfc.tajcbfc^SM (f'Srto-^miSL.cO 
B^x-^) *^<g«fl$nTt5*3, ±te^7^7>3-K (7 
KU;:^) fCj*)£LT^<D#Sfi*^ttl:^?nSo ^^ro 

[0 0 7 0] i^tC, *^B^c7)^2c7)||Sgpji:bT> 05 
{cli. ROMr-7;U9tcra-v^m{iEco^Sffi^«i^ 
bTi/>5li^Ci«ifi!c«:Sto 

[0 0 7 1] C<DE5fi:*5i/^r. Xfi^^^is^h'JyTs 
n-K^ilHlSS8$-C'«, laicDA;']*?!*^?.^'^;^ 
=i-Kfe4lllSS3Sr'i:l5HicD«fi!cT'feSo Ci:T\ ^ 
1 O R 0 Mr-^;!/ 4 *^:/a -y ^/*{^ET'*l,^•r- ^?;g:tB 
:^-tS<DfCj^L, E5«DR0MT-7;b9{iyo-y^># 

[0 0 7 2] SiSROMT-:/;U9*^?)ttl;'3?ns?^{fc 
liLfDro-yi^mffiOx-^ti, ra-y^7^(?¥|5issi 0 

icige>nSo ROMr-y;U9t7)tb:^{i, 

a<y^mffiT'feSfci6, 7ay ^5^ftl[HlK 1 Otc J; 
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mmmTli. ROMx-7";l'9i:7D-yi'5^ftf[HlSSl 0 
[00 7 3] ii^lC, 06tC(i, :$i^m(Dm3(0mm\i: 

[0 0 7 4] -r^ti-^, C©EI6(^^-r^3(7)SI)S6<5IJ<D 10 

cD7a7i'ili{i^«7f;7^';l/:Jf 1 A^-ftbXy ■< Jl^V 

y^'Ltctatitcom^ict^Lx ^y:^^m^m^mtj;i 
[0 0 7 5] comeicisi-'X. xiim^i 2Ki,m 

ffm-^n. [H1C<01, 0 5 t|SHicD7n«y>^fl:[5igS 
[0 0 7 6] SKr/D-y^^tmSSl 3(Dtii:'](i> 20 

/cffl;^i(4. tossii 5icig(gfi^tLTjic.nSc 

mg|] 5T'{i7'r-;l/^'U>t^^n/;:7a>yi7x-;jft7 
46 p)^?.;:^ loft So 

[0 0 7 7] iKOhm^i 5<Dtiifiii. i'^xn-Klg 
^HISSl 6lCjMP,n5o ^Ki'^T.a-K^tlHlSSl 6 30 
Tfe±l2i)nS§§l 5(^)aBtl7'D'>i'CD2i^?7tW*U'-^;L' 
^ifi<o^^ii-y^^mi'Xi'^7.^y!Mb. ^o^'yxa 

[0 0 7 8] COyfyT.n-Vlt. 7 h'U7.f-'$' tL 
TR0Mr-7;H 7lCjge,nSo aKR0Mr-7;l' 

WilA^ai:^^n?)J;'5tc%-5o 40 
[0 0 7 9] i:(DR0Mr-7";H 7*-'e>aJ:^^n/c:^ 
^ffiti:, ±l27'f;l/^fl 4<Dtb:^)AW©#i:tTttJ& 
?nTL^S*pSggi St;:, |ilC<*p||{I^i:UTiSl^n 

5o Ltzti^-ox. c(Dm3<ommm^Evi,A. ±fSRo 

Mx-r;!/! 7i:, 7-(';U^ i 4<7)tB:^*^^$&?nsto 

[0 0 8 0] )5:*5, ^3(D||)5!5<?lJOiaftlg7t^ST'«^ 

tc L r ^ 7 X 5>3S*fiiB-r ct d L r I > S 50 



i^P»g¥7 -6 7 0 2 8 
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m^i,£Xtimfk<Dy -<)V^ \ 4cotti;^tc«LT^vx5^ 

[008 1 ] ±a>(Di:3t, *f§WII)S6P<OiH0«7cti: 
fci/^T{±, iiKA^5^{t:bfcA:']iiif*^jia^gi (7D-y 

i'fb) U £:c07"D>y^li^f^-^A^^i'7X4fi!t*?T 

$tl/^:r-7■;^*^e,Mia7t^c^tfflt5r-^f 

[0 0 8 2] -t^b-fe. ilSA<^itbfcfflifl!^tt7£L<t 

nrc^Tiy—rji^m^x. ^{bb/iii#of^i*3 0ic* 
<b<D^i/^^7tiii®*aTfi46S t?.ci: 

[0 0 8 3] acDHoic. ^^mnmmx'ii. ^itntj: 

1/ 1/ ^fc^^r- 7";Hc cfc 5 V -y > i^filili^ 
[0084] LfcA^oT, *|ISS^J(DB#«7tgBfcJ; 

nif , fiajA (f -f u e A ^tct o ra^^ ntcmmcM 
tmni^itmm-^tircmmm?>ctti'^X'^^o 

[0 0 8 5] 

U 7X2y ^{t^nTc^-i'-^mL(D^77.\C^mLX 

- F tcfS i; T5^{blifi6tcm-r S'^fboSSi/ «*ai:/] 
1-§<kaJcUTi/->?.fc:i6. ?^{btOIMH*^#^T't*i/^^ 

fb L fcil#(D®7cA^pie6 i: ^ 
[0®cDf8j#*ltt0^] 

[0 1 ] 1 OS)il?iJ«^lifi«7cgBcojliiiS« 

fi5^*^^t7D >y HSSBT'feSo 

[02] *fg^||SSfi?lJ{Ct5tJ5^StCOI/^T(D^ 1 (Dfl. 
<*ffiJcD7n— f -v- FT'*-5o 

[03] *^^^)SSeiJfCt5{tS^StCOi/>T0^2<DS 
tt:0lJ<O7 n-f-v - h T'SSo 



(8) 



^$FffW7-6 7 0 2 8 
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[0 4] ^mM^mm'h'i^mm^m{ml^m^mmt^ 
[0 5] mz(D^mm(omimn.^m(ommmiS.^7r^t 
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